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ABSTRACT 

This paper describes the procedures used, and the 
results of ^ a state* wide assessment of eighth-grade pupils' opinions 
toward their schools. A Student Opinion and Attitude Poll was 
installed as a regular component of the Florida State-Wide 
Eighth-Gra^e Testing Program, Results deal with student attitudes and 
opinions 'ibout strictness and adequacy of rules, participation in 
decision -making, amount of freedom they perceive, frequency and 
seriousness of certain problems, feelings about different teaching 
methods, and perceived adequacy of the instruction on current 
problems. In addition to providing information o^x how Florida 
students view their schools, the report should be of general interest 
as an extensive implementation of affective measurement in a state 
testing program. (Author) 
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This paper describes the procedures used, and the results 
of, a state-wide assessment of eighth-grade pupils' opinions 
toward their schools. A Student Opinion and Attitude Poll 
was installed as a regular component of the Florida State- 
Wide Eighth-Grade Testing Program, 

Results deal v/ith student attitudes and opinions about 
strictness and adequacy of rules, participation in decision- 
making, amount of freedom they perceive, frequency and 
seriousness of certain problems, feelings about different 
^ teaching methods, and perceived adequacy of the instruction 

-N^s^ on current problems. 

>^ In addition to providing information on how Florida 

\ \, students view their schools, the report should be of general 

interest as an extensive implementation of affective measure- 
ment in a state testing program. 
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A State-Wide Assessment of Students Opinions About ' * 

Their Schools 

Jacob G. Beard and John J. Convey 
Florida State University 

The purpose of this paper is to describe the develop- 
ment, administration and results of an instrument for assess- 
ing the opinions of Florida public and private eighth-grade 
students about their schools. 

Typically, schools have been conceived, built, staffed, 
and operated, with little input from their clients, the 
pupils, who spend a large portion of their developmental 
years in the school environment. In 1973, a Student Opinion 
and Attitude Poll (SOAP) was installed as a regular compo- 
nent of the Florida State-Wide Eighth-Grade Testing Program. 
SOAP provides students with the opportunity to express 
opinions about their school, to evaluate and offer sugges- 
tions concerning some aspects of the school that directly 
effect them, and to indicate what action they would take in 
certain situations. 

The results from SOAP provide information to the school 
that can be helpful in: (a) obtaining an overall picture of 
how the, students view the school (b) measuring student atti- 
tudes toward particular aspects of the school and (c) obtaining 
feedback that might provide the basis for constructive 
changes in certain policies, practices, and programs. 



Development 

The 115 item multiple choice instrument was constructed 
by the Florida Eighth-Grade staff ,after extensive study of 
the technical and political problems in affective measure- 
ment in school settings. The instrument was designed to 
maximize the utility of the results for school personnel and 
to eliminate objectionable features such as "invasion of 
privacy", which often accompany non-cognitive testing. In 
order to achieve these goals, the following guidelines were 
adopted prior to the writing of individual 3J;ems. 

1. Items are to be phrased so that the responses would 
have maximum utility for school personnel. 

2. The item format should be simple and have a read- 
ability level low enough, so that almost all eighth- 
graders would be able to read and understand what 

is being asked. 

3. The number of items should be limited so that the 
Instrument could conveniently be included in the 
test battery. 

Items which deal too specifically with individual 
administrators and individual teachers are not to be 
Included in the Instrument, since It is not the in- 
tent of SOAP to evaluate these individuals* 
5. No Items are to be Included which might be construed 
to be an Invasion of the student *s privacy. 
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These guidelines were strictly adhered to throughout 
the project and, in retrospect, it is felt that their viola- 
tion would have had serious consequences for the program. 

The Instrument specifications evolved through the fol- 
lowing stages. First, an exhaustive list of aspects, or 
dimensions, of the school environment was prepared. This 
list was created by the program staff after reviewing the 
professional literature and after discussing the instrument 
with school personnel at many levels. The literature search 
included a survey of two instruments used at the secondary 
level: the Pennsylvania Student Questionnaire and Questa 
from Educational Testing Service (1971). 

After careful evaluation of the dimensions selected, an 
initial item pool was developed. Drafts of items and of 
complete instruments were circulated to appropriate state 
educational personnel, and their comments and suggestions 
were useful in refining the items. A content by process 
classification matrix evolved during the construction pro- 
cess and influenced the final development of the instrument. 
Preliminary forms were administered on several occasions to 
eighth-graders locally. On each of these occasions, student 
and teacher feedback was obtained and used in adding, revi- 
sion and deleting items. The instrument was then adminis- 
tered as part of the complete battery on a .trial basis in 
representative schools throughout the state. The final 
revision was made on the basis of data from this administration. 

ERIC 



Content by Process C] asslf Icatlon 
The Content by Process Classification Matrix for SOAP 
is shown In Table 1, with the item numbers included within 
each cello The content categories, shown in the leftmost 
column of Table 1, consist of the different aspects of the 
school environment assessed by the instrument. 

The process categories constitute the column headings 
of Table 1 and identify the type of response elicited by the 
item. The following process categories are used: 

1. Description - What I Think Is 

2. Evaluation - How Well Is It Functioning 

3. Suggestion - What I Should Be 
il. Action - What I Would Do 

A brief description of each process category follows. 

Description . The student is asked to choose the alter- 
native which he thinks best describes the situation with 
which the item is concerned* 

Evaluation . The student is asked to evaluate different 
aspects of the school environment. Some of the items in this 
category were designed to be similar to those in the des- 
cription category so that comparisons could be made between 
students' descriptions and evaluations. 

Suggestion . The student is given the opportunity to 
offer specific suggestions concerning certain present and 
future school policies. 
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TABLE 1 

Content by Process Classification Matrix for SOAP 



Content -£^S£ess_ 


Description 


Evaluation 


Suggestion 


Action 


Total 


School Rules: 
General 
Enforcement 
Personal Appearance 
Behavior 


6 
7.8 


1 

2 


3 
9 

10.11 




11 


pisoip line: 
Amount 

Administrated by 


14 


12,13 


15 




4 


Freedom: 

Personal Appearance 
Choice of Subjects 
Behavior 
General 




16,3L7 
18 

19,20,21 


22 




7 


School Spirit: 
Student Rapport 
School Clubs 
School Pride 
Miscellaneous 


24 
29,32 
33 


23,25,26,27,28 


31 
39 


30 
34 
35 


14 


School Problems: 
Student Learning 
General 
Cheating 
Stealing 
Dru^s 


37 
36 


42 
43 
44.45 


38 


40,41 


9 


Guidance Program: 
Personnel 
Procedures 
Activities 
Overall Effect 


46 

47,48,50 
51,52 


49 
53 






8 


School Subjects: 
General 

Types of Activities 


57,59 


55,56,61 


58.60 


54 


8 


Resources : 
Textbooks 
Materials 
Library 


62,63 
65,70 
66,68,69 


64 
67.71 






10 


Teaching Methods: 
Lecture 

Individualized 
Group Discussion 
Laboratories 


72 
76 
■ 80 
84 


73,74,75 
77.78,79 
81,82,83 
85,86,87 






16 


Life Problems: 
Class time spent 




88,89,90,91,92 
93.94,95 






8 


School Bathrooms: 
Appearance & Equip. 
Adequacy & Avail. 




96,97,98 
99,100,101 






6 


Classrooms: 
Appearance 
Adequacy 




102*103,105 
104 






4 


Lunchroom: 
Appearance 
Adequacy 
Pood 


110,111 


106,107 
108,109 
112 


114 


113.115 


10 



TOTAL • 33 «2 12 8 115 
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Action , The student Is asked to indicate how he would 
participate in various aspects of the school if .given the 
opportunity, and what action he would take if confronted with 
some problem. 

The SOAP Reports 

Each school received a report listing the percentage of 
students in that school, in the county in which the school 
is located, and in the state, that responded to each alter- 
native for each item in SOAP. County and state-wide distri- 
butions were reported in order to provide the bases for 
broader comparisons and for other analyses of the data that 
the school might wish to conduct. A sample page of the SOAP 
report is shown in Table 2. Some of the items and responses 
were shortened over the originals in the test booklet for 
convenient inclusion into the computer generated SOAP report. 

In addition to the results, each school received a man- 
ual to assist in the interpretation of the results. The 
nianual described some techniques which could be employed to 
facilitate understanding and use of the large amount of data 
provided by SOAP. Specific questions that could be answered 
by the data, were suggested. The school official for whom 
the questions seemed most appropriate and a list of the items 
that might help provide answers to the questions were in- 
cluded. 

No summary statistics or scores were reported. Item 
results seem to be more appropriate because of their direct 

ERIC 
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utility to the schools. Summary statistics and scores 
involve a synthesis of information, and thereby a potential 
loss of valuable detail. For example, a single score on a 
scale such as "student satisfaction" provides only very gen- 
eral information, and may conceal the fact that students are 
very satisfied with the amount of freedom they have, and very 
dissatisfied with the amount of learning they are experienc- 
ing. On the other hand, item results enable the school to 
determine exactly how the students responded to each alter- 
native. Furthermore, if the school deems it informative to 
do such, item results make it possible for the school to 
devise its own summary statistics. 

Administration 

The SOAP was administered as a part of the Florida State- 
Wide Eighth-Grade Testing Program battery. This program is 
offered, at no cost, to all public and private" schools in the 
state. It was anticipated that the announcement that such 
an instrument would be included in the program would cause 
some excitement, and it. did. However, several steps had been 
taken to prevent an unwarranted scuttling of the SOAP pro- 
gram. State education personnel were kept informed of the 
plans for the instrument and of progress in its development. 
All district superintendents were mailed a next-to-last 
draft of the instrument. As a result, only one district and 
a few individual schools elected to omit the SOAP portion of 
the testing program. The instrument was administered to 



about 120,000 eighth-grades (86^ of total eighth-grade en- 
rollment) in 351 of 366 public, 120 of 120 Catholic, and 69 
of 91 private schools that registered for the testing pro- 
gram. 

Results 

Space does not permit a complete listing of results in 
this paper. Selected results which may be of interest to 
the educational community are summarized below in Tables. 3-13 « 
The numbers included in the tables indicate the percentage 
of students in the state choosing that particular alternative. 
Approximately 90^ of the students who took the eighth-grade 
tests responded to each item in SOAP. The remaining 10^ are 
accounted for by individual students who decided to omit 
that item or by schools who omitted SOAP from their testing. 

Instruction 

The data indicated a slight preference for individual- 
ized work, group discussions and laboratory experiences over 
traditional lecture techniques (not shown). Topics dealing 
with drug abuse, sex education, family relationships, pover- 
ty, and race relations were seen as not receiving enough 
attention in the classroom. Opinion was divided on the 
adequacy of instruction on morality and war in today's 
world (Table 3). 

In general, the students felt that the schools were 
adequately helping them to learn about different areas of 
work and to learn, how to get along with other people (Table ^). 



10 



TABLE 3 

Amount of Instruction on Various Topics 



None Not Enough Right Amount Too Much 



Veneral Disease 


47 


18 


18 


3 


Drug Abuse 


23 


30 


27 


7 


Sex Education 


52 


17 


15 


3 


Morality 


19 


24 


28 


14 


Family Relationship 


42 


20 


20 


4 


War Today 


17 


26 


34 


9 


Poverty 


30 


26 


24 


5 


Race Relation 


28 


26 


24 


7 



TABLE 4 
Schools Helping 



Very Well Not Well Not At 

Well Enough Enough All 

Learn about, jobs l8 38 23 11 

Get along with others 15 39 22 13 



School Problems 

The students saw cheating and stealing as prevalent in 
the schools. Drug usage and ease of obtaining drugs at 
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school were seen as problems by roary students. Stealing was 
viewed as the one most sei'ious problem, followed by racial 
problems and drug usage (Tables 5, 6, and 7). 

TABLE 5 

Prevalence of Particular Problems 



A Lot Some Very Little None Don't Know 



Cheating 39 35 

Stealing 35 3^ 

Student Drug Usage 11 26 



12 3 NA 

17 ^ NA 

20 5 27 



TABLE 6 

Most Serious Problem in School 



Stealing 29 

Racial 24 

Drugs l6 

Personal Safety 9 

Alcohol 1 



About one third of the students indicated some kind of 
racial problem in the schools, and opinion was divided as to 
whether the situation had improved or become worse during 
the past year (Tables 8 and 9). 
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TABLE 7 

Ease of Obtaining Drugs at School 



Very Easy 


29 


Not Too Easy 


18 


Very Difficult 


10 


Don't Know 


32 



TABLE 8 
Harmony Between Races 



Very Well I'l 

About Average 37 

Not So Well 3^ 

No Such Students At School 5 



TABLE 9 

Relations Between Races During Past Year 



Improved 23 

Same 39 

Worse 22 

No Such Students 5 
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The student himself was seen as most responsible for not 
learning. The students suggested that troublesome students 
be either counseled or put into more interesting classes as 
opposed to suspending, detaining, or ignoring them (Tables 10 
and II). 



TABLE 10 

Responsibility for Student Not Learning 





Principal 


Teachers 


Parents 


The Student 


Other Students 


3 


17 


6 


60 


3 



TABLE 11 

Suggested Procedures for Handling Troublesome Students 



Counseled 32 

Place(5 Tn More Interesting Classes 27 

Ignored 13 

Detained 10 

Suspended 9 



Trust of Adults 

Most students i</ould prefer to go to the counselor about 
a serious problem in their school. Vfhen discussing personal 
problems, more would rather do so at home than with any adult 



at school. However, about one fourth of the students Indi- 
cated they wouldn't feel comfortable discussing personal 
problems with any adult (Table 12). 

TABLE 12 
Trust of Adults 





Discuss Serious 
Problems In School 


Discuss Personal 
Problems 


Principal 


11 


0 


Counselor 


^2 


19 


Teacher 


13 


8 


Parent /Relative 


17 


35 


Electeii Group of Students 


8 


NA 


No Mult 


NA 


2k 



Rulefl and Freedom 

About half of the atudenta felt that the schools had a 
sufficient number of rules and most of then (52.7%) felt 
that the rules were about the right level of strictness* 
Forty percent (40$) of the students sav the rules as too 
strict and 6.1% as not strict enough. The students felt 
that the schools were p^mlttlng an adequate a^>unt of free-^ 
doe In behavior^ subject choice, and hair styles, but not 
clothing (Table 13)« 
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TABLE 13 
Perceived Freedom 





Clothing 


Hair 


Choice 
of 
SubJ . 


Classrra* 
Behavior 


Lunchrsn* 
Behavior 


School 
Ground 
Behavior 


Too 
Much 


5 


8 


5 


9 


11 


9 


About 
Right 


39 


6C 


50 


51 


5*1 


50 


Not 

Enough 




15 


36 


31 


2H 


32 



Conclualon 

The Florida Eighth-Grade Prograa staff haa been pleaoed 
with the results of the Initial adnlnlstration of the Inatru^ 
ment and encourage other states to consider including slai- 
lar instruwents in their testing progran. 

The reaction to SOAP ha.« been generally positive and 
enthusiastic. r So far^ no fonaal studjf has been undertaken 
to assess the impact of SOAP on individual schools and dis-^ 
tricts thoughcut the state* Hon^^ver^ it is felt that an 
iiQpact has certainly f>een Mide and that good has resulted 
tron it^ in that scnoolis ha^e been sensitised to their stu- 
dents- ^feelings" • Several districts have r#quested and 
received pemission to a^toinlster the Instrus^nt at other 
than the eighth grade level « In addition^ thre instrument 
is presently being a4apted by a consortiuza of nine districts 
Q for use with parents and teachers* 

ERIC 



In addition to providing descriptive information to 
individual schools and districts that can assist the school 
in self assessment J the results constitute a large data bank 
of the opinions and attitudes of a segment of s^tudents toward 
certain aspects of their school. It is hoped that Uhis rich 
data base will facilitate longitudinal studies of changes in 
student opinions about their schools. 
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